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Abstract : We describe here an efficient algorithm for re- 
assembling one or more unknown objects that have been 
broken or torn into a large number N of irregular fragments. 
The puzzle assembly problem has many application areas such 
as restoration and reconstruction of archeological findings, 
repairing of broken objects, solving jigsaw type puzzles, 
molecular docking problem, etc. The pieces usually include 
not only geometrical shape information but also visual 
information such as texture, color, and continuity of lines. 
This paper presents a new approach to the puzzle assembly 
problem that is based on using textural features and 
geometrical constraints. The texture of a band outside the 
border of pieces is predicted by in-painting and texture 
synthesis methods. Feature values are derived from these 
original and predicted images of pieces. An affinity measure of 
corresponding pieces is defined and alignment of the puzzle 
pieces is carried out. The optimization of total affinity gives the 
best assembly of puzzle. Experimental results are presented on 
real and artificial data sets. 

Keywords: Image puzzle, image in-painting, image 
mosaicing, jigsaw puzzle 

l.Introduction 

Non overlapped image mosaicing is part of the 
mosaicing in which two images are not Non-overlapped. Torn 
image mosaicing or torn document mosaicing are new concepts 
in the field non-overlapped image mosaicing. Non-overlapped 
image mosaicing is the extended concept of puzzle 
reconstruction and torn document reconstruction. Images of the 
puzzles and torn fragments are non-overlapped images. This 
paper focuses on different types of algorithms for image 
mosaicing under non overlapped image mosaicing. It also 
surveys the general steps of non overlapped image mosaicing. 

Torn papers are considered as puzzle fragments in most 
of the literature. Puzzles can be defined as different objects of 
similar geometrical characteristics of connectivity. Various 
definitions of puzzles have been given in the literature [5] but 
overall views are similar to finding the connected puzzles with 
proper orientations. It was the aim from 1960's to find the 
solution for automatic puzzles organizations [8, 15]. Especially 
solutions to torn or shredded paper reconstruction had been 
suggested. Classification of puzzles, defined already in the 
literature [5, 6], has been specified to consider the shape and/or 
texture along the boundary for better performances. Most of the 
methods included in the literature are considered boundary end 
texture which is not sufficient for some applications like torn 
image reconstruction/mosaicing, text document reconstruction or 
textual reconstruction of the torn documents. 



Automatic software based solution for torn paper 
organization is a major requirement in the field of document 
reconstruction. Many researchers [6, 8] have reported different 
aspects of document and text reconstruction. The techniques like 
text document reconstruction and text reconstruction from torn 
document not only require extracting the shape of the boundary 
but also requires extracting the texture of the inner most text area 
for its reconstruction. 

The main steps in digital image processing are (i) 
preprocessing, which is a data preparation step for contrast 
enhancement, noise reduction or filtering, (ii) feature extraction, 
for retrieving non-redundant and significant information from an 
image. This operation is targeted at achieving time efficiency at 
the cost of data reduction followed by object detection, 
localization and recognition, which determine the position, 
location and orientation of objects. A plethora of algorithms 
targeted at the aforementioned objectives, has been evolved from 
time to time. In general, the characteristics and efficiency of an 
algorithm is determined by the domain of input data to be 
processed. Typical input domains comprise pixels, local 
features, image edges, embedded objects, to name a few. The 
output domains invariably comprise homogeneous image 
segments, edges of detected/localized objects, regions/segments, 
and different objects differing in size, shape, color and textural 
information. 

2.Problem Description & Requirement Specification 

2.1 Problem statement 

Torn image mosaicing or torn document mosaicing are 
new concepts in the field non-overlapped image mosaicing. 
Non-overlapped image mosaicing is the extended concept of 
puzzle reconstruction and torn document reconstruction. This 
paper focuses on different types of algorithms for image 
mosaicing under non overlapped image mosaicing. It also 
surveys the general steps of non overlapped image mosaicing. 
The techniques like text document reconstruction and text 
reconstruction from torn document not only require extracting 
the shape of the boundary but also requires extracting the texture 
of the inner most text area for its reconstruction. 

2.2 Proposed System 

The main aim of this paper is to reconstruct the torned 
document. There are two methods of reconstruction, (i) 
Apictorial method, which solves torn paper reconstruction 
problem with shape based matching method. The initial step of 
an apictorial approach is to calculate the boundaries of all 
fragments with proper shape representation, (ii) pictorial method, 
Torn images may have irregular torn boundaries. For stitching 
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purpose, it is necessary to find the geometry of boundaries of all 
torn pieces. Exact and sharp boundary identification is necessary 
for exact match identification therefore suitable method of 
boundary detection is required to be identified. Internal and 
external contents of torn image must be separated to exact 
visualization of all the variations of boundaries. Pictorial 
approach uses shape and texture (content based features) along 
the boundary of puzzles for the matching purpose. In this paper 
we will reconstruct torned document by document mosacing 
technique.During simulation we will scan all broken documents 
and then boundary detection,text extraction and corner detection 
of random host & guest piece will be performed. Second corner 
matching of host and guest piece will be performed and we will 
combine those pieces if match found. 

3. Proposed Approach Framework and Design 

3.1 Problem Definition 

In this project we are going to reconstruct the torned or 
fragmented documents by using torned document mosaicing 
technique. Previous works on the assembly problem have 
focused mainly on geometrical properties of the pieces. The 
puzzle pieces are represented by their boundary curves. Some 
approaches especially related to standard toy-store jigsaw puzzle 
solver use feature based matching methods. The jigsaw puzzle 
solving problem is a reduced and restricted version of the 
general assembly problem. 

3.2 Proposed Architecture 

Input 
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Fig 3.2.1 Architecture Design 

3.3 Process Flow 

1) Pre-processing. 

2) Alignment and Matching of Fragments. 

3) Merging of Fragments with seamless boundary. 

3.4 Pre-processing 



This step includes following, 

1) Text piece identification 

(i) Boundary detection 
High level feature extraction requires local and global properties 
as well as spatial relation of the image. Boundary or shape is the 
high level features of an image. Boundary detection task is 
useful for segmentation and recognition in an image processing. 
Color segmentation is one of the approach to find out the 
boundary of an unknown shape. Extraction of the boundary from 
an image can be perform by finding the set of pixels or points 
whose connected neighbor are not part of targeted region but lies 
on edges. The connectivity of the edge pixel with their neighbor 
will give us a boundary of the targeted region. The connectivity 
is checked using the 4 -neighbour connectivity or the 8- 
neighbour connectivity. The boundary can be defined by both 
type of connectivity of the neighbor pixels. 

L a*b color spaces [13] based color image segmentation 
algorithm[14]. 

Step 1: Read input image. 

Step 2: Convert input image from RGB to L*a*b color 
space. 

Step 3: Classify colors in a*b using k-means clustering. 
Step 4: label every pixel in image using result from k- 
means clustering. 

Step 5: Create image that segment the H &E image by 
color. 

Step 6: Segment nuclei into separate image. 
Here L*a*b indicates, 

L* is Luminosity layer 

a* is chrominocity layer which indicates where 
color falls along red-green axis. 

b* is chrominocity layer which indicates 
where color falls along blue-yellow axis. 
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Fig3.4.1 Boundary Detection Process. 
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Fig3.4.2 Boundary Detected image. 

(ii) Line detection 

Initial step in image processing stage includes feature like lines 
and curves detection from the images. Earlier proposed [l]-[2]- 
[9] techniques uses edge detection technique followed by the 
linear hough transform to detect the lines from the image. The 
line detection process includes filtering To carry line detec^on 
process the method of Hough Transform is used. Hoj^h 
Transform maps points in Cartesian image to curves in(itii£ 
Hough parameter space: (iv) 

p = x.cos0+y.sin0 (1) 

where p is the distance from origin to line along a vector. 

0 is the angle between x axis and this vector. 

This transform is used to to find lines in the input image. 

Line detection using Hough transform performed by converting 
a point in image space to the Hough space. One pixel or point in 
image space can be line passing from that point in Hough space. 

Hough transform based line detection techniques using 1) 
Standard edge detection , 2) Marr Hildreth edge detection and 3) 
Aniso-Tropic diffusion filtering with Marr Hildreth edge 
detection is performed on rich textured image and results are 
shown in figure3.4.3 



2) 



Orientation of fragments 



(i) In this step Lines along the texts words are detected using 
above method. 

(ii) Then Individual lines orientations are calculated. 

(iii)Global orientation is estimated from maximum lines 
orientations. 




I Rotated Fragment 

Fig 3.4.3 Line Detected image. 

3) Corner detection for matching of fragments 

This step includes following sub-steps, 
Boundary detection . 
Centroid estimation . 
Estimation of Distance histogram. 
Extraction of Corner points along pick points. 
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Fig 3.4.4Distance Histogram for pick detection 
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It includes following steps, 
Steps: 

(i) Plot LI and L2 lines along the boundaries of each 
corner using curve fitting. 

(ii) Find the Half-quadrants values (HQV) of LI and L2 
and 

(iii) Find the Angle between the Corner Lines (ACL) 
LI and L2. 
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Fig 3.5.1 Line plotted on boundary of each corner. 
Initial corner matching : 

Two criteria are decided for corner matching 

(i) Boundary at a corner (of particular half-quadrant) of 
a fragment is always inline with the boundary at 
matched corner (of opposite half -quadrant) of 
connected fragment. 

(ii) Angle between two boundaries at a corner of a 
fragment is 1 80 degree apart from that of at a matched 
corner of connected fragment. 

(iii) The corners (of Guest fragment) of opposite half- 
quadrants are paired with the corners of Host fragment. 
Remaining corners are rejected. 
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Final corner matching : 

(i) Select any random guest piece. 

(ii) Select any one of the matched corners from initial 
corner matching. 

(iii) Match the boundary alone that corner with host piece. 




3.6 Merging of Fragments with seamless boundary 

1. Dilation Process 

(i) Main aim is to extract text and merge the text from all 
the fragments without seam visualization. 

(ii) Dilation process is used to extract the text from 
fragments. 

2. Mask 3-point blending 

(i) Define Inner Blending Image in which object to be 
merged is available. 

(ii) Define Outer Blending Image whose background has to 
be merged. 

(iii) Create a mask from Inner Blending Image. 

(iv) 3 -Point pixels of the Inner Blending Image and Outer 
Blending Image along the boundary of the mask are 
considered as the 3 line pixels [63]. 
These 3-point pixels are merged by using Multi- 
resolution Spline technique [63] along the irregular 
shape of the mask to get a blended image. 



(v) 




Fig 3.6.1 Mask 3-point blending process. 

3. Mask creation 

(i) The inner Blending Image is converted into grayscale 
image. 

(ii) A grayscale image is converted into a binary image by 
Thresholding. 

(iv) The binary image is filled with holes (black pixels in 
the white portion) to remove noise. 

(v) All separated regions of binary image are identified and 
the only maximum area region is considered as the 
mask region. All remaining regions are left un-masked. 

4. Image In-painting 

(i) Identification of full common torn boundary 

(ii) Create uniform mask on the irregular boundary 

(iii) Image in-painting over CTB using Exemplar-Based In- 
painting technique [64] for mosaic image. 
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Fig 3.6.2 Image In-painting process 

4. Conclusion 

Non Overlapped image mosaicing can be classified as Torn 
image mosaicing and Torn text document mosaicing, we are 
focused on the reconstruction of text document. Reconstruction 
process gives the two resultant image as combined mask image 
and combined original image. Image in-painting will remove the 
visible seam line between the connected fragment and provides 
real view for given specimen. 
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